On the Bottleneck Concept for Options Discovery: Theoretical Underpinnings and Extension in Continuous State Spaces
نویسنده
چکیده
The bottleneck concept in reinforcement learning has played a prominent role in automatically finding temporal abstractions from experience. Lacking significant theory, it has however been regarded by some as being merely a trick. This thesis attempts to gain better intuition about this approach using spectral graph theory. A connection to the theory of Nearly Decomposable Markov Chains is also drawn and shows great promise. An options discovery algorithm is proposed and is the first of its kind to be applicable in continuous state spaces. As opposed to other similar approaches, this one has running time O(mn2) rather than O(n3) making it suitable to much larger domains than the typical grid worlds.
منابع مشابه
Continuous $k$-Fusion Frames in Hilbert Spaces
The study of the c$k$-fusions frames shows that the emphasis on the measure spaces introduces a new idea, although some similar properties with the discrete case are raised. Moreover, due to the nature of measure spaces, we have to use new techniques for new results. Especially, the topic of the dual of frames which is important for frame applications, have been specified completely for the c...
متن کاملThe extension of quadrupled fixed point results in K-metric spaces
Recently, Rahimi et al. [Comp. Appl. Math. 2013, In press] defined the concept of quadrupled fied point in K-metric spaces and proved several quadrupled fixed point theorems for solid cones on K-metric spaces. In this paper some quadrupled fixed point results for T-contraction on K-metric spaces without normality condition are proved. Obtained results extend and generalize well-known comparable...
متن کاملOn rarely generalized regular fuzzy continuous functions in fuzzy topological spaces
In this paper, we introduce the concept of rarely generalized regular fuzzy continuous functions in the sense of A.P. Sostak's and Ramadan is introduced. Some interesting properties and characterizations of them are investigated. Also, some applications to fuzzy compact spaces are established.
متن کاملTopological number for locally convex topological spaces with continuous semi-norms
In this paper we introduce the concept of topological number for locally convex topological spaces and prove some of its properties. It gives some criterions to study locally convex topological spaces in a discrete approach.
متن کاملAssessment of Women Agribusiness Cooperatives in Oyo State, Nigeria
The performance of women agribusiness cooperatives in Oyo State, Nigeria was assessed in this study. The study employed a multi-stage sampling technique to select 6 women cooperative groups (aggregating to 175 individuals); 36 individual women; and 4 institutions across 6 LGAs in two agricultural zones of the State. Findings show that majority (55.6%) of the respondents belong to processing org...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013